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J. R. Pierce has recently proposed a system for synchronizing an arbitrary 
number of geographically separated oscillators, and, under the assumption 
of zero transmission delays between stations, has shown that a certain linear 
model of the system is stable in the sense that all of the station frequencies 
approach a common final value as t — > °° . 

The purpose of this paper is to report on some results concerning the 
dynamic behavior of a nonlinear version of an important special case of 
Pierce's model. The nonlinear model takes into account transmission delays. 

It is proved under certain very general conditions that the nonlinear model 
possesses the stability property required of a synchronization system. More 
explicitly, it is proved that the model is stable for all nonnegative values of 
the delays. The results shoiv that the model possesses some additional funda- 
mental properties of engineering interest, and they provide an analytical 
basis for using a computer for further studies. In particular, a complete 
solution to the problem of determining the final frequency of the system and 
the final value of the content of an arbitrary buffer is presented, in the sense 
that it is shown that these quantities can be determined by solving a certain set 
of nonlinear equations which is proved to possess a unique solution. 

I. INTRODUCTION 

The purpose of this paper is to report on some results concerning 
properties of the solution f l {t), f 2 (t), • • • , f„(t) of the set of equations 



* This paper was presented as an invited contribution at both the Symposium on 
Mathematical Aspects of Electrical Networks (sponsored by the American Mathe- 
matical Society, New York City, April 1969) and the Joint Conference on Mathe- 
matical and Computer Aids to Design (sponsored by the ACM, SI AM, and IEEE; 
Anaheim, California; October 1969). 
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/.(') = *{g *«{jf &*(' " r„) - Mr)] dr + 6,,(0)}} + c< 

i = 1,2, • • • , n 

* 2S (1) 

in which n is an arbitrary positive integer such that n ^ 2, the <?,(•) 
and the <pi,(-) are monotone functions that map the real interval 
(—oo, oo ) into itself, the t,-,- are nonnegative constants, and the c { and 
the 6,-,-(0) are real constants. 

The set of equations (1) governs the behavior of a nonlinear model of 
the key part of a system for synchronizing digital transmission networks. 
Our main result is that synchronization is possible under very general 
conditions concerning the nonlinearities and the time delays t,-,- . In 
addition, an analytical basis for computing the final frequency of the 
system is presented; this involves proving that a certain set of nonlinear 
equations possesses a unique solution. Other results are presented con- 
cerning, for example, buffer requirements* and certain monotonicity 
properties of the frequency functions /,(•)• 

l.i Pierce's Model 

When Ta = for all i 9^ j, when <p f (x) = x for all i and all real x, and 
when (pa(x) = a tj x for all real x and all i s^ j, in which a,, is a real con- 
stant for all i t* j, we have 



hit) = E *,{£ [/,(r) - f,(r)] dr + MO)} + C, 



i = 1,2, ■•■ ,n t ^ 0. (2) 

Equations (2) are the equations of a linear model of the principal part 
of a system for synchronizing digital transmission networks recently 
proposed by J. R. Pierce. 1 His system employs oscillators of adjustable 
frequency and buffers which accept pulses at an incoming rate and which 
produce corresponding output pulses at the local clock rate. 

In Pierce's model the content &,-,- of the buffer at station i which ac- 
cepts pulses from station j is assumed to satisfy the equation f 

hiM = hit) - hit), t^o (3) 

in which f t (t) and /,•(£) are the frequencies at time t at stations j and i, 



* An explanation of the function of the device called a buffer is given in Section 1.1. 
f As usual, a dot over a mathematical aymbol denotes the derivative with respect 
to time. 
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respectively, and the overall system of coupled oscillators is assumed to 
satisfy equations (2) with a,, = a H ^ for all i ^ j. Under the natural 
assumption that there is some path from each station to every other 
station, Pierce has shown, by directing attention to a passive RL net- 
work analog of equations (2), that the model is stable in the sense that 
each frequency /, approaches the same final value as t — > *> .* 

1.2 The Nonlinear Model 

Our interest in the properties of the solution of equations (1) arises 
as a consequence of Pierce's work as follows. First, we wish to take into 
account the time delay T ti associated with transmission to an arbitrary 
station i from an arbitrary station j 7* i. Thus we replace /,(<) by /,(£ — 
m) in (3) and (2). The content 6,-,(0 of the ijth buffer is then 

f Mr - r„.) - /,(r)] dr + 6„(0) (4) 

for all t ^ 0. 

Our mathematical model of a buffer does not reflect the fact that the 
capacity of a real buffer is bounded; a real buffer is a device that can store 
at most some fixed finite number of pulses. Therefore it makes sense to 
study how a linear model of a synchronization system employing buf- 
fers, such as the one governed by (2), can be modified to reduce the pos- 
sibility of occurrence of buffer overload (that is, the possibility that the 
capacity of the buffers will be exceeded). It is therefore reasonable to 
replace the expression (4) for the buffer content by some monotone non- 
linear function </>,,(•) of (4), with the idea in mind that <?,•,(•) is a func- 
tion with moderate slope near the origin and very large slope correspond- 
ing to values of (4) that are in the neighborhoods of buffer overload. 
Similarly, in order to ease the requirements on the extent to which the 
frequencies of the adjustable oscillators must be variable, and in order 
to reduce the tendency of very large excursions in the frequencies /,- 
during a transient phase, it is reasonable to replace the sum 



Z vuibtM 



(•■>) 



formed at the ith station by some monotone nonlinear function <£<(•) 

* In Ref. 1 Pierce actually deals with a more general linear model than we haye 
described here, but treats in most detail the important case described above. In 
connection with the more general model, Pierce has exploited the network analogy 
further in order to obtain an expression for the final frequency, and to make asser- 
tions concerning the behavior of the system when certain elements are nonlinear. 
For additional material dealing with various aspects of the problem of synchronizing 
geographically separated oscillators, see, for example, Refs. 2-7. In particular, 
Ref. 4 contains a short history of the problem. 
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of (5), in which <?,(•) has moderate slope near the origin and very small 
slope far from the origin. 

These considerations lead at once to the study of the properties of the 
set of equations (1). Of course the crucial question is: "Does the system 
governed by (1) possess the basic stability property required of a 
synchronization system?" Our main result concerning (1) is that, no 
matter what the values of the time delaj^s r,,- , under some conditions 
which are quite trivial from the engineering viewpoint (and rather weak 
from the mathematical viewpoint), it does. 

II. SUMMARY OF RESULTS, AND SOME APPLICATIONS 

2.1 The Main Result Concerning (1) 

In order to describe the result, we first introduce some definitions and 
assumptions. 

Definition 1 : Let M denote an arbitrary n X n matrix with elements 
ma . Let the graph of M denote the graph containing n vertices (that is, 
n nodes), a directed edge (that is, a directed line segment or arc) from 
node j to node i for every pair i, j with i ^ j and m,,- ^ 0, and no other 
directed edges. 

Definition 2: Let M denote an arbitrary n X n matrix. Then we shall 
say that the graph of M is a communicating graph if and only if there is 
some path (not necessarily a direct path) from each node to every other 
node. 

We assume throughout the paper that: 

(i) th denotes an arbitrary nonnegative constant for all i 9^ j. 
(ii) For each i, <?,(•) denotes a real-valued continuously differenti- 
able function defined on (— °o, go) such that 

k< ^ riix) ^ k t (6) 

for all x, with k { and k t positive constants. 

(Hi) For each i ^ ;', <£>,,(■) denotes a continuously differentiable real- 
valued function defined on (— °o, oo) such that either tp tj (x) = for 
all x, or 

k ti ^ <p' tl {x) ^ hi (7) 

for all x, with &,, and £,,- positive constants.* 

* At the price of some additional complication, we could have replaced assump- 
tions (ii) and (ro) with assumptions concerning the behavior of the p,-( • ) and the ^>,,( • ) 
on finite intervals. See Section 2.2. 
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(iv) The matrix M defined by 

{M)u = for all i 

(M)„- = ^,(0) for all i ^ j 

is the matrix of a communicating graph. 

(v) Each /,(•) is defined and differentiable on [— f, <») in which 
f = maXi^-fr,-,-}. 

Assumption (iv) possesses a simple physical interpretation. It is a 
natural connectivity assumption of the type needed if synchronization 
is to be possible in the sense that all of the station frequencies approach 
a common final value as t — > <*> . 

Our basic set of equations is 



hit) = *«{g *>«{£' Mr ~ r tt ) ~ /««] dr + &,-,(0)}} + e« 



(8) 



for all i and all J ^ 0. By differentiating both sides of these equations with 
respect to t, we have 

fS) = v'Mt)] £ ri*K«0)][J#« - '-.,-) - MOL « ^ (9) 

for all z, in which of course 

Ut) = E«P./{/ o ' [/,(r - r„) - /,(r)] rfr + &,-,(0)| 

and 

&i(fl = f [//(t - r„) - Mr)] dr + &,,(0). 
•'o 

Let h {i (t) = p{fc<(OHIfc*(0] for all* £ and all j ^ i. Then 

hit) = E MOCfifl - r it ) - /,(0L * ^ o (io) 

for all i. According to Theorem 1 (Section III) the coefficients /i,,(-) 
of (10) are such that there exists a real constant p with the property that 
for all i, fi(t) — p — > as t — > °o . This means that the system is stable in 
the sense that all of the station frequencies approach a common final 
value. Note that this result does not involve assumptions concerning the 
values of the nonnegative delays t,,- , that it is valid for monotone non- 
linearities of a very general type, and that it does not involve symmetry 
assumptions such as <?,•,-(•) = ¥>,<(■) for all i ?*■ j. 
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2.2. A Monotonidty Property of the /,(•) 

The first of the two lemmas used in the proof of Theorem 1 asserts that 
the solution fi(-), fa(')> ' ' " >/»»(•) of (10) possesses an interesting mono- 
tonicity property. Let T be an arbitrary nonnegative value of time t, 
and let the upper envelope and lower envelope f(t) and f(t), respectively, 
of the fi(t) be defined for each t ^ — f by f(t) = max,- /,•(<), f(t) = 
min,- fi(t). Let f 7 (T) and / ? (!T), respectively, denote the largest and smal- 
lest value of f(t) and f(t) for t belonging to the interval [— f + T, T]. 
Then, according to the lemma just referred to, f(t) ^ fr(T) and f(t) ^ 
/ ? (T) for all t ^ T. In particular, since the /,•(£) approach a common final 
value, we see that the interval envelope functions ] 7 (T) and f*(T) ap- 
proach each other as T — > oo . 

Our assumptions (m) and (m) on the ^.(-) and the va(') concern the 
behavior of those functions for all, and in particular arbitrarily large, 
arguments. The upper and lower bounds just described show that it 
would have sufficed to have made similar assumptions on the behavior 
of the <Pi(') on any finite interval [—a, a] such that for all i 

<Pi(x) e [/? (0) — max c, , /?(0) — min c,J 

for all x t [—a, a]. On the basis of bounds of the type described in Sec- 
tion 2.4, similar statements can be made concerning the pertinent range 
of arguments of the tpa('). 

2.3. Final-Frequency Determination 

We now turn our attention to the matter of determining the final 
frequency of the model governed by (1). 
Let 

Pi(t) = (' /,(r) dr (11) 

•'0 

for all t ^ and all i. Then, since for all £ ^ 

f i,.(r - O dr = f ^ Ut) dr + f /,-(r) dr, 

we have, using (1), 

PS) = Vi[T,Vu\Pi(t - r„) - p,(0 + A,-,]} + c, (12) 

for all i and all t ^ 0, in which 

X„ - &„(0) + f /,(r) dr. (13) 
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According to Theorem 2 (Section III), there exists a unique real con- 
stant p and some real n-vector q such that 

p - <p t [ E Viii-pTa + Qi - qi + hi]} + 0i for all i. (14) 

it*i 

With p and q such that (14) is satisfied, let 

Pi(t) = pt + q< + r,(0, * ^ ~r (15) 

for all i, in which the q t are the components of q, and the r f (t) are some 
functions of t. Then, using (12), 

p + mo = *>.-{ E ^iC-p^* + «»• - «« + x « 

+ fi(«- r„) -r,(i)]} +c { (16) 
for all i and all * ^ 0. But, using (14) and (16), 

m) - ft{ £ #»«[*(< - r«) - ^(0 + •«]) - *<{ E «#[•«]) (17) 

for all i and all < ^ 0, in which s,,- = —pra + g,- — g, + X„ . 

For each i and each f s [0, «>), we have, by the mean-value theorem, 

<pA £ *ilh(« - «■«#) - r *(0 + »«]) - *•■{ E *#[•«]) 

= #>{[«<(<)]{£ *»«#&•*(< - t«) - r -(0 + ■«] - E *«[«##]} 

for some w,(0 such that M f (i) lies within the closed interval with end- 
points £,,., ?„[«„] and £,„< ^"W _ T ") ~ r «W + •«'!• Similarl y 
for each j ?* i and each 1 1 [0, «>), 

P<*fo(* - r„) - r,(0 + s,-,] - *><,[*< f ] 

= v:>.-,(0M* - r„) - r.Wl 

for a suitably chosen w,,(0- Therefore (17) can be written as 

r,(0 = Ec„(0[^- t„) -r,(0] (18) 

for all i and all « £ 0, where c„(0 = *>{[t**(*)k>$,4><,(0L But, by Theorem 
1, the coefficients c,,(-) of (18) are such that there exists a constant a 
with the property that for all i, r,-(<) -> a as i -> co . It follows [see (18)] 
that for all i, t $) -> as * -» » . Since 

f /,(r)dr = p«+ 5, +r,(i), i ^ 

Jo 

for all i, it is clear that p is the final value of the /,(•)• 
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According to Theorem 2: there exists exactly one real n- vector q such 
that, with U' T = (1, 1, • • • , 1), 

U"q - «{ 2 *>,-,-[- r,,-t/"g + ffi - g< + X,,]} + c- 

for all i, and p = U tr q. 

There are some simple special cases in which we can exhibit an ex- 
plicit expression for p. Suppose, for example, that m = for all i 7± j, 
that &,-,(0) = — 6,-,(0) for all i ?± j, and that <pa(x) = — <p,-,( — re) for 
all i 5* j and all real x. Then, using (14), we have for all i 

<pi\p - c.) = E *#fo - q< + K-m 

in which p7 x (0 * s the inverse of ?»,•(•)> aD -d 

2 ^(p - c.) = E E mi* - <?. - &.,(o)] = o. 

Therefore, np = V< c » ^ "P*^) = * f° r au " rea ^ * an( ^ au " *> or if n = 2 
and <Pi{x) = <p 2 {x) = — <p 2 (— x) for all real x. 

Finally, as a relevant application of the material of Section 2.2, we 
have when r,, = for all i j* j 

min fa + Vi { E *„[M0)]}) ^ p ^ max (e, + *>,{ E *«[MWJ) 
since f(t) ^ max,- /,(0) and /(f) ^ min,- /,(0) for all t ^ 0, and, by (1), 

MO) -d + *{E*,[fc,<p)]) 

for all i. 

2.4. Bounds on Buffer Content 

In order to analytically formulate specifications to be met by real 
buffers such that buffer overload does not occur in a real synchronization 
system of the type under study, it is natural to consider the problem of 
obtaining useful upper bounds on the contents of the mathematical buf- 
fers of our model. We do not treat this entire problem in detail in this 
paper. However, we show here that under some strong assumptions, it is 
possible to exploit the material of Sections 2.2 and 2.3 to obtain a simple 
uniform bound on buffer content. In addition, in terms of the constant 
p and the vector q introduced in Section 2.3, we present a complete 
solution to the problem of evaluating the final value of the content of an 
arbitrary buffer. 

According to Theorem 2, the vector q that satisfies (14) is unique to 



SYNCHRONIZING DIGITAL NETWORKS 2983 

within an additive ?i-vector of the form all, in which a is a real constant 
and U is the transpose of (1, 1, • • ■ , 1). In particular, the quantity 
A„ = (max, q { — min, q { ) associated with any solution pair p, q of (14) 
is unique. In this section it is shown that when 

T . . = b,-,(0) = for all i ^ j, (19) 

then the magnitude of the content 

[/,(r) - Mr)] dr (20) 



r 



of an arbitrary buffer is bounded for all t ^ by 2A a . 
Let (19) be satisfied. As in Section 2.3, let 



P,(0 = [' U(r) dr, t ^ 

Jo 







for all i. Then with p,-(<) = pt + q< + r,-(0, J ^ for all i, in which p and 
5 satisfy (14), we find as in Section 2.3 that for suitably chosen functions 
w,(-) and Wij(-), 

r,(t) = I>,,(0M0 -r,(t)], it (21) 

for all i, in which c«(0 = ¥>$[«<(*)]*{*[«>«(')]■ Since (21) is an equation 
of the same type as (10) (more precisely, see Lemma 1 of the proof of 
Theorem 1), it follows that for all t ^ 0, r&) ^ max, r,(0) and r«(t) ^ 
min,- r,(0). But r,(0) = — #,- for all t. Thus, for any j and i with j ^ t 

P,(0 - p.-(«) = Q, ~ ff< + r,(0 - r,(0, 1 ^ 
^ 2A , « ^ 

and, similarly, p,(/) - p,-(0 ^ -2A„ , f ^ 0. 

Concerning the problem of evaluating A, , there are some cases in 
which it is possible to obtain simple and useful upper bounds. In one 
simple case we can obtain an explicit expression for A a . For example, 
suppose that (19) is satisfied and that n = 2. Suppose also that <pi(x) = 
tp 2 ( x ) = — <p 2 ( — x) for all x, and that tp l2 (x) = <pn(x) = — <p 2 \{—x) for 
all x. Then p = p,[pi a (g 2 - ffi)] + c { , p = <p 2 [<P2i(qi— q%)] + c 2 , and, using 
the fact that <p 2 (-) and <p 2 i(-) are odd, 2ip x [<p 12 {q 2 — <?,)] = c 2 — c x . 
Therefore, in this case A a = | q 2 — Qi \ = I <pll[<p7 l [i(fi» - Ci)]} |. 

We now consider the matter of (proving the existence of and) evaluat- 
ing the final value lim,^ &,,(<) of the content of an arbitrary buffer. 
With p, q, the r.-(-), and the p.-(-) as defined in Section 2.3, we have for 
t ^ and any i 7^ j 
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MO - f Mr ~ r it ) - /,(r)] dr + &,,(0) 

- Pi(t - r„) " p,(0 + 6,,(0) + £ /,(r) dr 

- -pr«, + g, - ?< + r,(« - r„) - r,(f) + 6„(0) + ( /,(r) dr. 
Since ?•,(£ — r,-,) — r,(i) — > as t —* °o, we have the result 

lim bM = -pr„ + g,- - g« + 6„(0) + f /,(r) dr. (22) 

!-•» J -Tii 

Finally, if (19) is satisfied, then, using (22), 

max | lim &,•,■(£) | = max | q,- — q { \ = A Q , 

which shows that our uniform bound 2A„ is not unreasonable. 

2.5 Discussion 

The results presented in this paper are concerned with a reasonably- 
realistic strongly-nonlinear model of an important type of synchroniza- 
tion system. They answer several key questions concerning the dynamic 
behavior of the system, and provide an analytical basis for using a com- 
puter for further studies in so far as we have proved, for example, that a 
solution pair p, q of the set of equations (14) exists, that this pair is 
unique in the sense indicated, and that it can be determined by com- 
puting the unique solution q of a related set of equations. 

On the other hand, although we have proved that under very general 
conditions our nonlinear model possess the basic properties of a syn- 
chronization system, in this paper we have not considered the next 
natural problem, that of determining the extent to which the system 
performance can be improved as a result of the presence of the non- 
linearities. There are several other important practical problems that 
are not considered here, such as the problem of predicting the effects of 
variable transmission delays (due to temperature changes). There is a 
clear need for much more work in this area, especially in connection with 
the problem of comparing the performance of alternative synchroniza- 
tion systems. 

III. THEOREMS 1 AND 2 

Throughout Sections III and IV: 
(i) n denotes an arbitrary fixed positive integer such that n ^ 2; 
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the statement "for all i" means for all i = 1, 2, • • • , n, and "for all 
; 5^ i" means for all j t {1, 2, • • ■ , n) except j = i. 

(ii) With v an arbitrary n-vector, v" denotes the transpose of v. 
The zero n-vector is denoted by 6. 

(Hi) If x denotes a differentiate function of t, then x indicates the 
derivative of x with respect to t. 

(iv) All functions and constants considered are real valued. 

The following two theorems are proved in Section IV. 

Theorem 1: Suppose that the following conditions are satisfied: 

(i) For each i ^ j, a,,(-) denotes a nonnegative bounded measurable 
function defined for all t e [0, «> ) . 

(ii) With a and a positive constants such that a ^ a, for each i t± j, 
«,,(•) satisfies either a.,(0 = for all 1 e [0, oo) or a ^ a ti (t) ^ a for 
alltt [0, oo). 

(Hi) For tt [0, oo ), the n X n matrix A, with (A) a = a ti {t) for all 
i 5^ ; and (A) {i = for all i, is the matrix of a communicating graph.* 
(iv) For each i ^ j, t 1( denotes a nonnegative constant and f = 
max.v, Ta . 

(v) For each i,x { (-) denotes a differentiable function defined on [ — f, » ) 
such that 

Ut) = £ «n(0[*i(< - *«) - »i(0], < ^ o 

/or aM i. 

77ien //iere exists a constant p such that x(t) — pU — > 6 as t — * °°, m 

Mfcfcfc U = (1,1, ■■■ ,l) tT . 

Theorem 2: Suppose that assumptions (i) through (iv) in Section 2.1 are 
satisfied. Let U denote the n-vector (1,1, ■■ ■ , l) tr . Then (a) there exists a 
unique n-vector q such that 

U tr q = <Pi{ £ 9<il-T tt U lr q + q t - q< + M) + c. for all *, 

w which the X,,- and </ie c, are constants, and (b) concerning the solution 
P, q of 

P = ¥><{ E «»«*[- PT„ + 0; - g, + X,,]| + c< for all i, 

the value of p is unique, and q is unique to within an additive n-vector all, 
in which a is an arbitrary real constant. 



* See definitions 1 and 2 in Section 2.1. 
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IV. PROOF OF THEOREMS 1 AND 2 

In this section: 

(i) l n denotes the identity matrix of order n. 
(ii) The transpose of any matrix M is denoted by M tr . 
(Hi) If v is an n-vedor, then \\ v \\ denotes (v tT v)*. 
(iv) If F denotes an n-vector-valued function, then (F), denotes the 
i lh component of F. 

4.1. Proof of Theorem 1 

We first prove the following lemma. 

Lemma 1: Suppose that (i), (iv), and (v) of Theorem 1 are satisfied. 
For all t t [— t, co), Ut x(t) and x(t) denote max x a (t) and min, x Q (t), 
respectively. Let T be a nonnegative constant. Then, for all t ^ T, x(t) ^ 
sup [ _ F+r>rl x(t) and x(t) ^ inf^r+T.T] x(t). 

Proof: (upper bound) We have for all * 

Ut) = Z OtMM* - r„) - x t (t)], t ^ 0. (23) 

Thus 

x<(t) + x t (t) 2 <*</(<) - S M*)*,(< - t„), ' ^ 
and 

x f (t) = x t (T) exp [-£ £ a it (t) rf<] 

+ f exp - /" £ o„(0 d* £ a 1J (r).T,(r - r„) dr, < ^ T (24) 

for all i. 

It is convenient to introduce the function /(•, •, •) defined by 

I(u, v, k) = exp [^-| u £ a*,(«) <*<J 

for all real w ^ v and all positive integer k ^ n. Thus, for example, (24) 
is equivalent to 

x,(t) = x,(T)I(T, t, i) + f I(t, t, i) £ «.yW.T,(r - t„) dr, 

t^T. (25) 
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Let t denote an arbitrary positive constant. There exist an index fc 
and a t x t [T, T + * ] such that 

xM = sup x(t). 

I T. T+tml 

Clearly 

xM = x k {T)I{T, /, , fc) + /(t, «i , fc) E «»f»*(T - T *>) dT - 

Therefore, since the a*,- are nonnegative, 

r' ' 
xM ^ x k (T)T(T, /, , fc) + /(t, <i , fc) E o»/W ^ 

■' r if'* 

•max sup x,(0 

|Vt IT-fli.'i-'lil 

r' 1 
^ x k (T)I(T, U , &) + / '( T » 'i . fc ) E »«W <*t sup x(t). 

But 

f" Z(r,«, , fc) £«M(r)dT = 1 - I(T, it , fc). 



Thus 



»»(*,) ^ z,(T)/(7\ «i , fc) + [i - J(r, e, , fc)] sup x{t). 

I r-T,i ■ I 



Either 



sup .f(/) ^ sup x(t) (26) 

IT-T.r) I t. * . i 



or 



sup HO > sup .f(0- (27) 

ir-?,n ir.i.i 

If (26) holds, then 

xM <, x k (T)I(T, h , fc) + [1 - I(T, U , k)]xM 

[since x k (t x ) = sup,^.,,) x(t)], and hence 

•r,(/,) ^ x t (D, 

which implies that x k (t { ) g sup ir _ ? . r , x(t). If (27) holds, then [since 
x k (T) ^ sup Ir _ f . n x(t)] 
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xM ^ I(T, t, , k) sup x(t) + [1 - I{T, U , fc)] sup x(t) 

IT-t.T] IT-f.TI 

^ sup x(t) . 

IT-t.T) 



We have shown that 



sup x(t) ^ sup x(t). (28) 

[r.r+fo] [r-?.ri 

But i is an arbitrary positive number. Therefore 
sup x(t) ^ sup x{t) . 

tZT [T-T.T] 

(lower bound) Our proof of the inequality 

inf x(t) ^ inf x(t) (29) 

UT [T-r,T\ 

parallels the derivation of the upper bound, and is outlined below. 
There exists an index I and a t 2 1 [T, T + t ] such that 

Xi(t 2 ) = inf x(t). 
ir.r+u) 



Thus 



x t (t 2 ) ^ x t (T)I(T, t 2 ,l) + [l- I(T, t 2 , 0] inf x(t). (30) 

ir-f,i,] 



Either 



or 



inf x{t) ^ inf x(t) 

IT-t.T] [T.I,] 



inf x{t) < inf x(t). 
it-t.t\ ir.iii 



In either case, we find using (30), that (29) is satisfied. □ 

We note that it is a consequence of Lemma 1 that the components of 
x(-) are bounded on [0, °o), and, since x(-) and x(-) are related by (23), 
that the components of £(•) are bounded on [0, <»). 
Assume that 

sup x(t) — inf x(t) 

lu-f.u] [u-r.ul 

[x(-) and x(-) are defined in the statement of Lemma 1] does not ap- 
proach zero as u — > °o . We shall show that this assumption implies that 
the components of x(-) are not bounded on [0, °°), a contradiction. 
Since, by assumption, sup [u _ ?iU] x(t) — inf [u _r. U ] x(t) does not ap- 
proach zero as u — * ■», there exist a positive constant e and a set {w,,}" 
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with u„ e [0, oo ) and sup, u Q = oo such that 

sup x(t) - inf 3?(0 ^ 2e 

[U,-T.U 1 iUj-f.U,] 

for all q. For each 5 let t Q z [u„ - f, u„] and t' Q z [u Q - f, u g ] be such that 

x(t q ) = inf x(t) 

[»«-T.»,] 

z(fj) = sup £(£)• 

(U,-T.u a l 

Of course sup„ t Q = °o and | « a — tj | ^ t. Thus there exists a set {X,}" 
of real constants such that | X„ | ^ f f or all q, with the property that 
x(t Q + X„) - x(t Q ) ^ 2e for all q. It follows from the definition of x(-) 
and x(-)that for each q there exist indices l(q) and s(q) such that 
Xu Q) (t a + X a ) - x.(,)(0 ^ 2e. 

Finally, since the components of x(-) are bounded on [0, co), there 
exists a positive constant 5 such that for all q x Ha) (t + X„) — x, (a) (t) ^ e 
for allied - |8, t a + §«]. 

At this point we need the following lemma. 

Lemma 2: If the hypotheses of Theorem 1 are satisfied, if T is a non- 
negative constant, and if there exist three positive constants t a , e, and 8 and 
indices l(q) and s(q) such that t Q — \8 > T -\- t and Xu Q) {t + X a ) — 
ar. (o ,(0 ^ e for all tz[t Q - K t Q + §5], with X a a constant and | X, | ^ 
t, then there exist positive constants £ and A such that, with x(t) as defined 
in the statement of Lemma 1 , 

sup x(t) ^ sup x(t) — A 
*s{ ir-T.n 

and A depends only on a, a, f, e, and 8. 

Proof: 

As in the proof of Lemma 1, it is convenient to introduce the function 
/(•, -, •) defined by 

I(u, v, k) = exp — J 2 a *»( T ) dr\ 

for all real u % v and all positive integer k ^ n. The relation between 
T, f, t Q , and 5 is indicated in Fig. 1. 
From (23) 

Xi (t) = XtfflHT, t, i) + f I(t, t, i) 2 a i; .(T):r,(T - r„) dr 
for all t ^ T and all i. By Lemma 1, x{t) ^ supi r _ ? . rl x{t) for all t ^ T. 
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—i — i — i.r { ■ 

T-T T t q 

Fig. 1 — Relation between T, f, /,, 5. 

Therefore 

sup x(t) - z.cCO ^ e (31) 

ir-f, n 

for all tt[t Q - J5, t Q + §5]. 

Let /c! be an index such that a Al , <„,(/) 5^ for all i ^ 0. Then for 
t ^ «, + §5 + f 

aj».(0 - ^(T)I(T, t, k x ) + ( 7(r, i, fc.) £ a tl ,(r).r ; .(r - T kli ) dr 

^ I(T, t, fc,) sup x(t) 

IT-r.Tl 

+ / 7(r, t, /cO X a kli {r)Xi(T — r klf ) dr 

J T jVt, 

7(t, i, fei)a*..<a>0').E.<<,>(T — r*i.<«>) dr 
+ / 7(t, £, ^^..(^(^.(^(t — T k ,, (Q) ) dr 

+ / 7(t, £, fci)a* t . (C )(r)g t(C )(r - r fc „<,)) dr. 

«'/, + J5 + 7- tl ,(,) 

By Lemma 1, for each j, 

*,(t - r,,,) ^ sup .f(0 (32) 

ir-?, t\ 

for all r ^ 7 1 + r t ,,- . But (32) is obviously satisfied also for r e [T, T + 
r tl ,]. That is, (32) holds for all t ^ 7 1 and all j. Thus, using (31), 

•c,.(0 ^ W, «, fci) sup x(t) 

[T-r.T] 

+ / i( T , t, fc,) 2 a *.f( T ) dT su p *0) 

"T j'^ii [r-T.ri 

/.r,+ §S + Ti ll( ,) 

- e / 7(r, /, fc,)a tli( „(T) rfr 

«'/,-15 + r ll ,(,, 

^ sup £(0 — e / 7(t, i, fci)a tll((J) dr 

17— ?-?*l • / '«-i* + rt I .(,) 
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for all I ^ t Q + \b -\- f, since 

f Kt, t, A-,) £ a 4l ,(r) dr = 1 - /(T, /, A-,). 
But, for all k t , 
/ 7( T> /, fc,)a*..c,)(r) rfr ^ a / e -(-.)-(.-) dT 

^ Jv exp { -0[i - /, - n,. (a) - £5] | 

in which /S - (n - l)a and A' = a{l - exp [-(■/? - l)o«]}[(w - 1)&]~\ 
Therefore 

.r,,(0 ^ sup x(t) - eK exp {-/3[J - /, - t*,. ( „ - J*]) 

I r-r.ri 



for all t ^ £, + $5 + f. In particular, 

sup x(t) - .r,,(0 ^ e^e 

IT-r.ri 



-|3(J + r) 



for all H [t Q + §5 + f, <„ + f 5 + f]. Similarly, if the index fc 2 is such that 
a fc , fcl (0 ^ for all t ^ 0, we have for all t ^ t g + § 5 + 2? 

.r,,(/) = x kt (T)I(T, t, fc 2 ) 

+ f /(r, /, A- 2 ) £ Ot,,(T)a;,(T - r*„) dr 
^ sup x(t) — eh e 

I T-t , T] 

•exp {-/*[/ - t Q - r,,,, -f« -7]}. (33) 

In particular, for 1 1 [t a + f 5 + 2r, /„ + f 5 + 2t] 



-2 -20(5-tr) 



sup f(0 — x tl (0 = e ^ v '" fi 
[T-f.n 

Since the graph of A is a communicating graph, we may continue in 
this manner to obtain an upper bound of the type (33) for all of the 
*»(•)• More explicitly, for each ^t {1, 2, • • • , n], let {fej , k» , • • • , A; p } 
denote a finite set of positive integers, with the integer p dependent on 
k x , such that [ki , k 2 , ■ ■■ , k p ] D {1, 2, • • • , n} and 

ak,k,a ktk , ■ ■ ■ a M(j .,, 5^ 0, £ ^ 0. 

Then, with £ = sup, r _ ? . ri x(t), v = <r" (a+f) , and 

T r = t„ + |5 + f + (r - 1)(5 + r) for all r = 1, 2, • • • , /), 
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we have 

x kl (t) £B- d&-"«- f<, -* ,, > t ^ r, 

x k ,(0 ^ B - eK 2 ue-" f e-' {t - T '\ t ^ T 2 

x kf (l) ^ B - eK"u p - 1 e- p7 e- pu ~ Tp) , t £ T p . 
Now let t = T v + 77 with 77 e [0, ?]. Then 

rr*.(0 SB- eKe -v e -^-in^ e -e, 

x k2 (t) £ B - 6K 2 w e - ,? V^ (p - 2,(5+f> e -'"' 

x* p (0 ^ 5 - eKV"V S V' i, . 
Thus, for all < e [T, , 7 1 ,, + f], 

x kr (t) ^ B - A tl 
for all r = 1, 2, ■ • • , p, in which 

A*. = min {eKV-V 2 "V (l, - r)(i+f) }. 

Let A = min*, A tl , and observe that A depends only on a, a, f, e, and 
5. By Lemma 1, 

x(t) ^ B - A 

for all t ^ T p + f . D 

Since as indicated earlier, there are an infinite number of 5-intervals 
with centers t a such that sup {t q } = °o, and such that there exist in- 
dices l(q) and s(q) with the property that 

*,(„(<+ K) ~ x.iAt) ^ * (34) 

for all 1 1 [t q — \b, t Q + 5 5], with the constants X, such that | X„ | ^ f 
we see that Lemma 2 and the assumption that 

sup x(t) - inf x(t) (35) 

[U-T,U1 [U-T.u) 

does not approach zero as u — * 00 imply that £(<) — » — 00 as t — > °o , 
which contradicts the fact that x(-) is bounded on [0, °o). Therefore 
(35) approaches zero as u — > °o. But, by Lemma 1, sup lu _ ful x(f) is 
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monotone nonincreasing in u and bounded from below. Thus there is a 
constant L such that 

sup x(t) — * L 

[u-f.ul 

as U -* °°. Similarly, by Lemma 1, inf, u _ ? , ul x(t) is monotone non- 
decreasing in u and bounded from above. Thus there is a constant 
L such that 

inf x(t) -> L 

iu-T.u] 

as u _> oo. But we have proved that L = L. Therefore x(t) and x(t) 
both approach L as i — * °° , which means that there is a constant p such 
that 

x(£) — pU — > as *— ><». D 

4.2. Proo/ o/ Theorem 2 

In part (a) of this proof we employ a theorem of R. S. Palais* ac- 
cording to which: if F(-) is a continuously-differentiable mapping of 
real Euclidean w-space E n into itself with values F(q) for q e E n such that 

(i) det J a ?^ for aM qt E", in which «/„ is the Jacobian matrix of 
F ( • ) with respect to q, and 
(ti) lim,,,-.. || F(g) H = •, 

then F(-) is an invertible mapping of E n onto itself and F(-)' 1 is con- 
tinually differentiable on E n . 

We have 
U lr q = *f £*<*[- r«tf"ffi+ g, - ?,• + X,,]} + c- for all i. 

Let F(-) denote the mapping of E n into itself denned by the condition 
that for all i and all q e JET: 

[F(g)] ( - = £/ ,r g - ftllM-'«l7"« + to - ** + X «M- 



*»*> 



Our objective is to show that F(-) satisfies conditions (i) and (n) of 
Palais' theorem. 

We have, with F { denoting [F(-)L , 

zr* = 1 + <p'i E (1 + 'Mi ^r all * 

dq< j*i 



* See Ref. 8 and the appendix of Ref. 9. 
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and 



in which 



and 



= 1 + (pi 2 Tifp'u - (p'ip'k for all k 9* i 



<p'< = rf(E P«l- Tv&'q + q, - 7. + X.,]) 



<p'a =<p' ii [-T ii U"q+ q t - g, + X„]. 
Let /3, y = pj$>< ( . for all i 5^ ;, let V be the w-vector defined by 

V" = (1 + E ft#T„ , 1 + E/3 2) r 2j - , • • • , 1 + Z ArfT„), 

and let B denote the n X n matrix defined by 

(£),,= Z/3., for all*, (B)„ - -ft, for all * * ;. 

Then J„ = 5 + 7l7 lr . 

Suppose now that det «/ = for some n-vector q. For that q, there 
would exist an ?i-vector x 9^ 6 such that J[ T x = (B' T + C/F' r )^ = 9. 
Since the column space of B' r is orthogonal to J7, we must have B ,T x = 8 
and y' r z = 0. But B is of rank (n — 1) and the cofactors of B are non- 
negative.* 

Thus B tr x = 6 implies that x = %y, in which y is any column of the 
matrix of cofactors of B and £ is some real nonzero constant. 1 But we 
must have V tT x = £V lr y = 0, which is a contradiction, since at least one 
element of y and all of the elements of V are positive. Therefore F(-) 
meets condition (i) of Palais' theorem. 

We now show that F( • ) satisfies condition (ii) of the theorem of Palais. 

It is a simple matter to verify that for all i 

F t - U"q - P| Er,.,.[-T,.,t/' r g + g, - q<] - *[E*«ft«)] 

in which 

Pt{'Lvii[-Ti,U lr q+ q, - q t + X,,]} - *{£*„[X„]} 



f% = 



JL<Pn[-TiiU tr q + q, - q { + X,,] - £ Vafrif] 



* See Ref . 10 for a proof that B is of rank (n — 1 ) and that the cofactors of all of 
the (B)a elements of B are positive. Since BU = 6, each of the columns of the 
transposed matrix of cofactors of B is proportional to the vector U (see the footnote 
that follows). Therefore all of the cofactors of B are positive. 

* This follows from the well-known proposition that M tr C = 1„ det M, in which 
M is any square matrix and C is the matrix of cofactors of M. 
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and 

= <Pn[—TiiU' r q + g,- - Qi + X,-,-] - <?.•,!>,/] 
r " -rutf'q+qi-qt 

with the understanding that r { is unity when the corresponding numera- 
tor is zero, r if is zero for all q and all i 9^ j for which <p ti is identically 
zero, and r ti is unity for all i 7* j for which tp ti is not identically zero and 
for all q for which the corresponding numerator is zero. Therefore, for 
all q e E n , F(q) = Mq + s, in which the nXn matrix M is obtained from 
J„ by replacing rf by r< and tp' ti by r, f - for all i and all * 7* j, respectively, 
and the ith. component of s is — <p,£;v.- p,-,(X,-,)] for all i. In particular, 
det M ^ for all q. Therefore det (M tr M) > for all q. Since all of the 
r,- as well as all of the nonidentically zero r it are bounded above and 
below by positive constants uniformly for q t E n , there exists a positive 
constant e such that det (M tr M) ^ e for all q e E n . 

Let X t , X 2 , • • • , X„ denote the eigenvalues of M tr M. Then XiX 2 • • • X n 
^ e for all q e #". Assume that X x ^ X 2 ^ • • • ^ X n . Since all of the ?\ 
and all of the r ti are bounded from above uniformly for q e E n , there 
exists a positive constant X such that X„ ^ X for all q e E n . Thus, for all 
qt E n we have \ 2 ^ eX _( " _1> . Therefore, 

II F(q) II = II Mg +* II ^ II Ma II ~ II s II 

^ A*" 11 """ || 9 II - lh || 

for all g e #", from which it is clear that || F(q) || — > » as [| g || — > w 
This completes the proof of part (a) of our theorem. 

Next we show that there is at most one p with the property that there 
exists a q e E" such that for all i 

P = <P<{ J^Vai-pTij + g, - g< + X,,]} + c, . 

Let p (o) and p <fc> be two constants, and q ia) and g ct> two n-vectors, such 
that for all i 



p 



la) = ft{Ef«[-P w r« + g) a> - ?. (a> + M) + * 



lV 1 



(6) _ 
p — p 



< {E^[-p (6, '-.- I + g, (fc) -gr > + x.-,-]} + c 



Then with g (c) = g (i) + a 17, in which the constant a is chosen so that 



p 



<"> _ p <»> = [/' r (g (a) - q lc) ), we have for all i 



' = ^IE^[-p ,c, t„- + g) c) - g' c) + X,,.]j + c, 



i 
P 
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where p w = p w . Thus 



u 

p 



»Vt" 

- wlE^t-Vm + <?,- e> - ?i c) + x„]j 

and 

(a) (c) _ rrlr/ (a) (e)\ 

p — p = U {q — q ). 

Therefore we can define nonnegative ratios p,- and p,,- similar to the 
r, and r,-,- above, such that 

U"(q M - q le) ) = pi EpJ-CTfo" - q 1 "^ 

+ (gj a) - g,- e) ) - (g. u> - ?<")] for all t, 

and such that these equations are equivalent to M'(q la) — q (c) ) — 6 
in which the n X n matrix M' is obtained from «/„ by replacing <p' { by 
p, and (p' u by p,-,- for all i and all i 5^ ;*, respectively, so that det M' 5^ 0. 
But this implies that q ia) = q le) and hence that p <0> = p (6) . 

We shall how prove that q is specified to within an additive vector 
of the form all in which a is a real constant. 

Suppose that, with q la) and q (b> two n-vectors, 

P - <P.{2>./[-pr,,- + g! o) - ff, w + X.-,-]} 

= p — *>*{ £?«[- p*h + g»- 6) — ?.- 6) + A o]} 

for all i. Then, with the p, and p,,- as introduced above, 

p i Zp* , -?r l )-(9!° , -?! 6, )] = o 

for all «. Thus, since p, 5^ for all i, and the n X n matrix P defined by 
(P)a = Ep« . for all* 

(P),-,- = — p,,-, for all t* 7^ j 

is of rank* (n — 1), and PC/ = 0, we have # (a> — g (6> = aC/ for some real 
constant a. □ 



* See Ref. 10. 
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